Apparatus and method for multilayered music playback based on wireless device data

ABSTRACT

Method and apparatus of operating an electronic device for playback of a multilayered media file are provided. The method includes receiving device data from a triggering device via a wireless protocol, the device data related to a plurality of triggers of the triggering device, each of the triggers is associated with a distinct layer of a plurality of layers of the multilayered media file. The method further includes controlling playback of the plurality of layers of media associated with the multilayered media file based on the device data.

CROSS-REFERENCE TO RELATED APPLICATION(S) AND CLAIM OF PRIORITY

The present application is a continuation in part of U.S. patentapplication Ser. No. 14/088,178, filed Nov. 22, 2013, entitled“APPARATUS AND METHOD FOR MULTILAYERED MUSIC PLAYBACK”. The presentapplication claims priority to U.S. Provisional Patent Application Ser.No. 61/863,824, filed Aug. 8, 2013, entitled “APPARATUS AND METHOD FORLAYERED MUSIC PLAYBACK”; the content of the above-identified patentdocument is incorporated herein by reference.

TECHNICAL FIELD

The present application relates generally to playing media, morespecifically, to multilayered media.

BACKGROUND

Music includes several layers, such as vocals, guitar, drums, etc. Eachlayer can have a unique sound and may share a similar tempo and pace.Combined, the layers of music form a musical composition.

Playback applications allow digital devices to play music and videos.Playback applications generally play entire compositions that includeseveral layers of music. As playback applications grow more complex,there is a need for controlling the playback of individual layers ofmusic.

SUMMARY

A method of operating an electronic device for playback of amultilayered media file is provided. The method includes receivingdevice data from a triggering device via a wireless protocol, the devicedata related to a plurality of triggers of the triggering device, eachof the triggers is associated with a distinct layer of a plurality oflayers of the multilayered media file. The method further includescontrolling playback of the plurality of layers of media associated withthe multilayered media file based on the device data.

A method of a triggering device used for playback of a multilayeredmedia file is provided. The method includes transmitting device datafrom a triggering device via a wireless protocol. The device datarelated to a plurality of triggers of the triggering device. Each of thetriggers is associated with a distinct layer of a plurality of layers ofthe multilayered media file. An electronic device that receives thedevice data controls playback of the plurality of layers of mediaassociated with the multilayered media file based on the device data.

An apparatus for playback of a multilayered media file is provided. Theapparatus includes a receiver configured to receive device data from atriggering device via a wireless protocol. The device data related to aplurality of triggers of the triggering device. Each of the triggers isassociated with a distinct layer of a plurality of layers of themultilayered media file. The apparatus further includes one or moreprocessors configured to control playback of the plurality of layers ofmedia associated with the multilayered media file based on the devicedata.

Before undertaking the DETAILED DESCRIPTION below, it may beadvantageous to set forth definitions of certain words and phrases usedthroughout this patent document: the terms “include” and “comprise,” aswell as derivatives thereof, mean inclusion without limitation; the term“or,” is inclusive, meaning and/or; the phrases “associated with” and“associated therewith,” as well as derivatives thereof, may mean toinclude, be included within, interconnect with, contain, be containedwithin, connect to or with, couple to or with, be communicable with,cooperate with, interleave, juxtapose, be proximate to, be bound to orwith, have, have a property of, or the like; and the term “controller”means any device, system or part thereof that controls at least oneoperation, such a device may be implemented in hardware, firmware orsoftware, or some combination of at least two of the same. It should benoted that the functionality associated with any particular controllermay be centralized or distributed, whether locally or remotely.Definitions for certain words and phrases are provided throughout thispatent document, those of ordinary skill in the art should understandthat in many, if not most instances, such definitions apply to prior, aswell as future uses of such defined words and phrases.

BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of the present disclosure and itsadvantages, reference is now made to the following description taken inconjunction with the accompanying drawings, in which like referencenumerals represent like parts:

FIG. 1 illustrates an example electronic device according to embodimentsof the present disclosure;

FIG. 2 illustrates a diagram of a system for multilayered media playbackin accordance with embodiments of the present disclosure;

FIG. 3 illustrates a system for multilayered music playback based onwireless device data according to embodiments of the present disclosure;

FIG. 4 illustrates a packet encapsulating device data in accordance withembodiments of the present disclosure;

FIG. 5 illustrates a graphical user interface (GUI) for multilayeredmedia playback in accordance with embodiments of the present disclosure;

FIG. 6 illustrates a flowchart for multilayered music playback based onwireless device data; and

FIG. 7 illustrates a flowchart for multilayered music playback based onwireless device data.

DETAILED DESCRIPTION

FIGS. 1 through 7, discussed below, and the various embodiments used todescribe the principles of the present disclosure in this patentdocument are by way of illustration only and should not be construed inany way to limit the scope of the disclosure. Those skilled in the artwill understand that the principles of the present disclosure may beimplemented in any suitably arranged electronic device.

FIG. 1 illustrates an example electronic device 102 according toembodiments of the present disclosure. The embodiment of the electronicdevice 102 shown in FIG. 1 is for illustration only. Other embodimentsof an electronic device could be used without departing from the scopeof this disclosure.

The electronic device 102 includes an antenna 105, a radio frequency(RF) transceiver 110, transmit (TX) processing circuitry 115, amicrophone 120, and receive (RX) processing circuitry 125. Theelectronic device 102 also includes a speaker 130, a processing unit140, an input/output (I/O) interface (IF) 145, a keypad 150, a display155, and a memory 160. The electronic device 102 could include anynumber of each of these components.

The processing unit 140 includes processing circuitry configured toexecute instructions, such as instructions stored in the memory 160 orinternally within the processing unit 140. The memory 160 includes abasic operating system (OS) program 161 and one or more applications162. The electronic device 102 could represent any suitable device. Inparticular embodiments, the electronic device 102 represents a mobiletelephone, smartphone, personal digital assistant, tablet computer, atouchscreen computer, and the like. The electronic device 102 playsmultilayered media.

The RF transceiver 110 receives, from the antenna 105, an incoming RFsignal transmitted by a base station or other device in a wirelessnetwork. The RF transceiver 110 down-converts the incoming RF signal toproduce an intermediate frequency (IF) or baseband signal. The IF orbaseband signal is sent to the RX processing circuitry 125, whichproduces a processed baseband signal (such as by filtering, decoding,and/or digitizing the baseband or IF signal). The RX processingcircuitry 125 can provide the processed baseband signal to the speaker130 (for voice data) or to the processing unit 140 for furtherprocessing (such as for web browsing or other data). The RF transceivercould also be an infrared (IR) transceiver, and limitation to the typeof transceiver is not to be inferred.

The TX processing circuitry 115 receives analog or digital voice datafrom the microphone 120 or other outgoing baseband data (such as webdata, e-mail, or interactive video game data) from the processing unit140. The TX processing circuitry 115 encodes, multiplexes, and/ordigitizes the outgoing baseband data to produce a processed baseband orIF signal. The RF transceiver 110 receives the outgoing processedbaseband or IF signal from the TX processing circuitry 115 andup-converts the baseband or IF signal to an RF signal that istransmitted via the antenna 105.

In some embodiments, the processing unit 140 includes one or moreprocessors, such as central processing unit (CPU) 142 and graphicsprocessing unit (GPU) 144, embodied in one or more discrete devices. Insome embodiments, the CPU 142 and the GPU 144 are implemented as one ormore integrated circuits disposed on one or more printed circuit boards.The memory 160 is coupled to the processing unit 140. In someembodiments, part of the memory 160 represents a random access memory(RAM), and another part of the memory 160 represents a Flash memoryacting as a read-only memory (ROM).

In some embodiments, the memory 160 is a computer readable medium thatstores program instructions to play multilayered media. When the programinstructions are executed by the processing unit 140, the programinstructions cause one or more of the processing unit 140, CPU 142, andGPU 144 to execute various functions and programs in accordance withembodiments of this disclosure.

The processing unit 140 executes the basic OS program 161 stored in thememory 160 in order to control the overall operation of electronicdevice 102. For example, the processing unit 140 can control the RFtransceiver 110, RX processing circuitry 125, and TX processingcircuitry 115 in accordance with well-known principles to control thereception of forward channel signals and the transmission of reversechannel signals.

The processing unit 140 is also capable of executing other processes andprograms resident in the memory 160, such as operations for playingmultilayered media as described in more detail below. The processingunit 140 can also move data into or out of the memory 160 as required byan executing process. In some embodiments, the processing unit 140 isconfigured to execute a plurality of applications 162. The processingunit 140 can operate the applications 162 based on the OS program 161 orin response to a signal received from a base station. The processingunit 140 is coupled to the I/O interface 145, which provides electronicdevice 102 with the ability to connect to other devices, such as laptopcomputers, handheld computers, and server computers. The I/O interface145 is the communication path between these accessories and theprocessing unit 140.

The processing unit 140 is also optionally coupled to the keypad 150 andthe display unit 155. An operator of electronic device 102 uses thekeypad 150 to enter data into electronic device 102. The display 155 maybe a liquid crystal display, light emitting diode (LED) display, orother display capable of rendering text and/or at least limited graphicsfrom web sites. Display unit 155 may be a touchscreen which displayskeypad 150. Alternate embodiments may use other types of input/outputdevices and displays.

FIG. 2 illustrates a diagram of a system for multilayered media playbackin accordance with embodiments of the present disclosure. The system ofFIG. 2 can be implemented in electronic device 102 and embodied as oneof a computer, a smart phone, a tablet, a touchscreen computer, and thelike. Application engine 206 receives one or more of gesture inputs 212from touchscreen 202 of display unit 155, and may also receive devicedata 214 from triggering device 204. Application engine 206 controlsplayback of media files 210 that are combined to form multilayered mediafile 216 based on one or more of gesture inputs 212, device data 214,and definition file 208 via sound engine 220.

Gesture inputs 212 include one or more touch gestures that indicate whenand how touchscreen 202 is being touched. Gesture inputs 212 include atap gesture, a long press gesture, and a drag gesture. With a tapgesture or a long press gesture, a touch starts and ends atsubstantially the same point on touchscreen 202 on display 155 ofelectronic device 102. With a tap gesture, the touch is held atsubstantially the same point on touch screen 202 on display 155 for asubstantially short period of time, such as with a threshold for theshort period of time of 0.5 seconds or less. With a long press gesture,the touch is held at substantially the same point on touch screen 202 ondisplay 155 for a longer period of time, such as with a threshold forthe longer period of time of 0.5 seconds or more. Additional thresholdsmay be used for a long press gesture with each threshold associated witha different action to be taken by the application 162. With a draggesture, the touch is at least partially moved while it is being held ontouchscreen 202 of display 155 of electronic device 102 and is helduntil the touch is released.

Output from application engine 206 is displayed on the display 155 andoutput from sound engine 220 is played on speaker 130. The combinationof application engine 206 and sound engine 220 form an application, suchas application 162. Display 155 comprises touchscreen 202. Whendisplayed, output from application engine 206 can be shown to simulatetriggering device 204 on display 155.

Multilayered media file 216 comprises a plurality of musical programs orlayers, such as media files 210 that each comprises one or more audiofiles and video files. Multilayered media file 216 can be downloadedfrom the Internet and includes definition file 208. Each of the musicalprograms comprises a subset of a predetermined musical composition,shown in FIG. 2 as media files 210, which are also referred to as alayer of media. Each of the musical programs or layers of media iscorrelated to each other and comprises sound elements configured togenerate sympathetic musical sounds. A trigger can be associated with amusical program to control the timing and playback of the musicalprogram. When multiple media files are played together, an entire songor composition that incorporates each of the layers of media files 210can be heard and seen via display 155 and speaker 130. Applicationengine 206 and sound engine 220 control which media files 210 ofmultilayered media file 216 are played and when media files 210 areplayed based on gesture inputs 212, device data 214, and definition file208. Certain media files 210 can lasts an entire length of the song,whereas other media files 210 may last for a shorter duration, and canbe referred to as a one-shot. Multilayered media file 216 can be anarchive file comprising additional files. In certain embodiments,multilayered media file 216 is derived from a single MP3 or WAV file.

Definition file 208 describes media files 210 and one or more beamlayouts for application engine 206 and sound engine 220. Based on theinformation of definition file 208, application engine 206 and soundengine 220 determine specific timings for when media files 210 areplayed based on one or more of gesture inputs 212 and device data 214.

FIG. 3 illustrates a system for multilayered music playback based onwireless device data according to embodiments of the present disclosure.The embodiments of electronic device 102 and triggering device 302 shownin FIG. 3 are for illustration only. Other embodiments of an electronicdevice and a triggering device could be used without departing from thescope of this disclosure.

System 330 includes triggering device 204 and electronic device 102.System 330 plays back a multilayered media file, such as multilayeredmedia file 216, via electronic device 102. The layers or musicalprograms of multilayered media file 216 are controlled via device datatransmitted and received between triggering device 204 and electronicdevice 102 via a wireless connection. The wireless connection is inaccordance with a wireless personal area network (WPAN) protocol, suchas Bluetooth Low Energy (BLE).

Triggering device 204 is a portable handheld device that can bewirelessly connected to electronic device 102 to control playback ofmultilayered media files. Triggering device 204 receives user inputsthat are communicated wirelessly to electronic device 102. Triggeringdevice 204 includes lasers 304, memory 334, universal serial bus (USB)controller 308, sensors 324, switches 326, encoder 328, and BLE device310. The components of triggering device 204 can be implemented on asingle semiconductor device or on a plurality of discrete semiconductordevices.

Lasers 304 are contained within triggering device 302 to provide beamsof light external to triggering device 204. Lasers 304 provide visiblelight. Each beam of light is directed to one of sensors 324.

Sensors 324 detect light from lasers 304. Sensors 324 convert an opticalsignal from laser 304 into an electrical signal used to indicate a userinput.

In conjunction, lasers 304 and sensors 324 operate to provide a beambreak system. A beam of light from a laser 304 is directed to a sensor324 that receives the beam of light. When sensor 324 receives the beamof light, this is translated into a binary one to indicate that the beamof light is being received by sensor 324. When the beam of light is notreceived by sensor 324, this is translated into a binary zero toindicate the beam of light is not being received by sensor 324. A usercan break the beam by placing an object, such as a finger, hand, pen,etc., between one of lasers and 304 and a respective one of sensors 324to prevent the beam from the laser from reaching the sensor. The stateof the sensor is communicated to electronic device 102 and is used byelectronic device 102 to control playback of a layer of multilayeredmedia.

Universal serial bus (USB) controller 308 is a discrete semiconductordevice or is part of a discrete semiconductor device within triggeringdevice 204. USB controller 308 receives device data related to one ormore switches 326, encoder 328, and sensors 324 and transmits the devicedata in accordance with the USB protocol to BLE device 310.

BLE device 310 is a discrete semiconductor device or is part of adiscrete semiconductor device within triggering device 204. BLE device310 receives device data from USB controller 308 and wirelesslytransmits device data 214 to electronic device 102 in accordance withthe BLE protocol. BLE device 310 includes Bluetooth 4.0 protocol stack312 and profile 314.

Bluetooth 4.0 protocol stack 312 is software that allows fortransmitting and receiving data via the BLE protocol. Bluetooth 4.0protocol stack 312 receives device data 214 of triggering device 204 andtransmits device data 214 via the BLE protocol to electronic device 102.

Profile 314 is software that defines how data is communicated via theBLE protocol. Profile 314 defines triggering device 204 as a humaninterface device (HID).

Switches 326 are one or more electromechanical switches or buttons.Switches 326 convert mechanical inputs from a user of triggering device204 into electrical signals that define a portion of device data 214.Switches 326 include a mute button, a record button, a volume downbutton, a volume up button, a rhythm button, a last song button, a swapbutton, and a next song button. The mute button allows a user toindicate whether playback of a multilayered media file should be muted.The record button allows a user to indicate whether playback of amultilayered media file should be recorded. The volume down buttonallows a user to indicate whether volume of playback of a multilayeredmedia file should be decreased. The volume up button allows a user toindicate whether volume of playback of a multilayered media file shouldbe increased. The rhythm button allows a user to indicate whether arhythm layer of a multilayered media file should be played. The lastsong button allows a user to switch from playing a current song to aprevious song. The swap button allows a user to swap the functionalityof one or more beams or triggers. The next song button allows a user toswitch from playing a current song to a next song.

Encoder 328 digitally encodes a user input to a plurality of bits. Toincrease volume, encoder 328 outputs a hexadecimal value of 0x01 (1). Todecrease volume, encoder 328 outputs a hexadecimal value of 0xFF (−1).When neither an increase nor a decrease is indicated, encoder 328outputs a hexadecimal value of 0x00 (0). In particular embodiments, whena sensor bit of sensor status payload 404 indicates a trigger associatedwith the sensor bit is activated, changes to the plurality of encoderbits are associated with a change of an attribute of a layer associatedwith the trigger. For example, when a beam is broken, changes to theencoder can be used to change a volume attribute of the layer or musicalprogram associated with the beam.

Controllers 332 include one or more electronic controllers that executeprograms and instructions stored in memory 334 in order to control theoverall operation of triggering device 204. For example, Controllers 332can control lasers 304, sensors 324, switches 326, and encoder 328 todetect user inputs that are used to control playback of multilayeredmedia.

Memory 334 is a computer readable medium that stores programinstructions, embodied as firmware 306, to receive user inputs andtransmit device data. When the program instructions are executed bycontrollers 332, the program instructions cause one or more of thecontrollers 332 to execute various functions and programs in accordancewith embodiments of this disclosure. Memory 334 includes firmware 306.

Device data 214 is wirelessly communicated between triggering device 204and electronic device 102. When transmitted, device data 214 can be inthe form of a packet, such as packet 402 described in FIG. 4. Devicedata 214 includes device data related to one or more of sensor status,switch status, encoder status, and error status.

Electronic device 102 could represent any suitable device. In particularembodiments, the electronic device 102 represents a mobile telephone,smartphone, personal digital assistant, tablet computer, a touchscreencomputer, a desktop computer, and the like. The electronic device 102plays multilayered media and includes OS 161 and application 162.

OS 161 includes program instructions to control the overall operation ofelectronic device 102. OS 161 includes core Bluetooth protocol stack316, user interface (UI) 318, and application shared code 320.

Bluetooth protocol stack 316 is software that allows for transmittingand receiving data via the BLE protocol. Bluetooth protocol stack 316receives device data 214 from triggering device 204 and allows forapplication 162 to read and use device data 214.

UI 318 is a part of OS 161 that allows a user to interact with theapplications and programs of electronic device 102. UI 318 allows a userto control features and functions related to playback of multilayeredmedia via application 162.

Application shared code 320 is code that is shared between applicationsto perform features and functions of electronic device 102. Application162 can use portions of application shared code 320 that relate toBluetooth protocol stack 316 and UI 318 to receive device data 214 andoutput media based on device data 214.

Application 162 includes application engine 206 and sound engine 220.Application engine receives device data 214, which is used byapplication engine 206 and sound engine 220 to control playback ofmultilayered media.

FIG. 4 illustrates a packet encapsulating device data, in accordancewith embodiments of the present disclosure. The embodiment of packet 402shown in FIG. 4 is for illustration only. Other embodiments of a packetencapsulating data could be used without departing from the scope ofthis disclosure.

Packet 402 is a data packet formed in accordance with an HID profile ofone or more of USB and BLE protocols. Packet 402 includes sensor statuspayload 404, switch status payload 406, encoder status payload 408, anderror status payload 410.

Sensor status payload 404 includes a plurality of bits b0 through b3.Plurality of bits b0 through b3 each indicates a state of a sensor, suchas one of sensors 324. The state of sensors 324 indicate user inputsused to control multilayered media playback.

Switch status payload 406 includes a plurality of bits b0 through b7.Plurality of bits b0 through b7 of switch status payload 406 indicates astate of one or more switches, such as switches 326, of triggeringdevice 204. The value of bits b0 through b7 of switch status payload 406indicate user inputs used to control multilayered media playback.

Encoder status payload 408 includes a byte (eight bits). The byte ofencoder status payload 408 indicates a change to a volume ofmultilayered media playback. A hexadecimal value of 0x01 (1) indicatesvolume is to be increased by one unit. A hexadecimal value of 0xFF (−1)indicates a volume is to be decreased by one unit. A hexadecimal valueof 0x00 (0) indicates no change is to be made to a volume.

Error status payload 410 includes a plurality of bits b0 through b3.Plurality of bits b0 through b3 each indicates an error state of asensor related to triggering device 204. In particular embodiments, eachbit indicates a particular error status. Additionally, particularembodiments can use one or more groups of bits to encode multiple errorstatuses.

FIG. 5 illustrates a graphical user interface (GUI) for multilayeredmedia playback in accordance with embodiments of the present disclosure.The embodiment shown in FIG. 5 is for illustration only. Otherembodiments could be used without departing from the scope of thisdisclosure.

The GUI of FIG. 5 is an embodiment of UI 318 of FIG. 3. UI 318 includesseveral user interface (UI) elements to manipulate multilayered mediaplayback. UI 318 is displayed on touchscreen 202 to allow a user tointeract with the UI elements of UI 318.

Buttons 506 and 514 provide for switching between different multilayeredmedia files. Interaction with button 506 causes the application 162 toswitch to a previous multilayered media file in a playlist. Interactionwith button 514 causes the application 162 to switch to a subsequentmultilayered media file in a playlist. Buttons 506 and 514 areassociated with bits b2 and b0, respectively, of switch status payload406. Changes to switch status bits b2 and b0 are displayed via UI 318 onbuttons 506 and 514. A user can manipulate either switches 326 oftriggering device 204 or buttons 506 and 514 displayed on UI 318 tochange between a last song and a next song.

Volume slider 520 provides for adjusting volume of playback ofmultilayered media files. Interaction with volume slider 520 causes theapplication 162 to increase or decrease a volume of playback of amultilayered media file, such as multilayered media file 216. Volumeslider 520 is associated with the byte of encoder status payload 408.Changes to the byte of encoder status payload 408 are displayed via UI318 on volume slider 520. A user can manipulate either switches 326 oftriggering device 204 or volume slider 520 displayed on UI 318 to adjustvolume.

Display of beam 542 on UI 318 includes text elements 538 and 540. Textelement 538 indicates a name of the instrument and layer of mediaassociated with beam 542. Text element 540 indicates additionalinformation about the instrument and layer of media associated with beam542. As illustrated by text elements 538 and 540, the layer of mediaassociated with beam 542 is an instrument named “saw synth” with a pulseof one sixteenth note. Text of text elements 538 and 540 and which typeof attribute is shown in text element 540 can be defined in a beamlayout of multilayered media file 216, such as in definition file 208.Beam 542 on UI 318 is active, as indicated by the display of beam 542 ascompared to beams 548, 554, and 560, which are not active. Beam 542 isassociated with a bit, e.g., bit b0, of sensor status payload 404.Changes to bit b0 of sensor status payload 404 are displayed via UI 318and beam 542. A user can interact with either the beam break system oftriggering device 04 or beam 542 displayed on UI 318 to trigger andcontrol playback of a layer or musical program of multilayered media.

Button 566 allows for recording output of the current playback ofmultilayered media. When button 566 is interacted with via a tapgesture, processing unit 140 causes the combined media that includes allof the active layers of media of multilayered media file 216 beingplayed to be recorded to a memory, such as memory 160 of electronicdevice 102, so that the recorded combined media can be played backwithout having to re-create all of the user inputs and touch gesturesthat created the current playback. Button 566 is associated with bit b6of switch status payload 406. Changes to switch status bit b6 aredisplayed via UI 318 and button 566. A user can manipulate either aswitch of switches 326 associated with bit b6 of switch status payload406 of triggering device 204 or button 566 displayed on UI 318 to changewhether a session is being recorded.

Button 568 allows for swapping instruments or beam layouts in a currentplaylist session. When button 568 is interacted with via a tap gesture,processing unit 140 causes the functionality of one or more beams 542,548, 554, and 560 or triggers to be swapped. Button 568 is associatedwith bit b1 of switch status payload 406. Changes to switch status bitb1 are displayed via UI 318 and button 568. A user can manipulate eithera switch of switches 326 associated with bit b1 of switch status payload406 of triggering device 204 or button 568 displayed on UI 318 toperform a swap.

Button 570 allows for starting or stopping a rhythm layer of media. Whenbutton 570 is interacted with via a tap gesture, processing unit 140causes the rhythm layer of media of multilayered media file 216 to beoutput via speaker 130. Button 570 is associated with bit b3 of switchstatus payload 406. Changes to switch status bit b3 are displayed via UI318 and button 570. A user can manipulate either a switch of switches326 associated with bit b3 of switch status payload 406 of triggeringdevice 204 or button 570 displayed on UI 318 to start or stop the rhythmlayer of multilayered media.

FIG. 6 illustrates a flowchart for multilayered music playback based onwireless device data. While the flowchart depicts a series of sequentialsteps, unless explicitly stated, no inference should be drawn from thatsequence regarding specific order of performance of steps, or portionsthereof, serially rather than concurrently or in an overlapping manner,or performance the steps depicted exclusively without the occurrence ofintervening or intermediate steps. The process depicted in the exampleis implemented by any suitably configured electronic device, such aselectronic device 102 of FIG. 1.

At step 602, each of one or more triggers is displayed as a beam ondisplay 155 of electronic device 102. Each trigger is associated with abit of a sensor status payload of a packet of device data that iscommunicated wirelessly between electronic device 102 and triggeringdevice 204. Each trigger is associated with a layer of media of amultilayered media file.

At step 604, electronic device 102 receives device data from triggeringdevice 204 via a wireless protocol. The device data is related to thelayer of media.

At step 606, electronic device 102 controls playback of the plurality oflayers associated with the multilayered media file based on the devicedata. Electronic device 102 also controls display of UI 318 based on thedevice data.

FIG. 7 illustrates a flowchart for multilayered music playback based onwireless device data. While the flowchart depicts a series of sequentialsteps, unless explicitly stated, no inference should be drawn from thatsequence regarding specific order of performance of steps, or portionsthereof, serially rather than concurrently or in an overlapping manner,or performance the steps depicted exclusively without the occurrence ofintervening or intermediate steps. The process depicted in the exampleis implemented by any suitably configured electronic device, such astriggering device 204 of FIG. 2.

At step 702, triggering device 204 receives user input for one or moretriggers. Each trigger is associated with a bit of a sensor statuspayload of a packet of device data that is communicated wirelesslybetween electronic device 102 and triggering device 204.

At step 704, triggering device 204 transmits device data to anelectronic device via a wireless protocol, the device data related tothe layer of media. Each trigger is associated with a layer of media ofa multilayered media file.

Although the present disclosure has been described with an exemplaryembodiment, various changes and modifications may be suggested to oneskilled in the art. It is intended that the present disclosure encompasssuch changes and modifications as fall within the scope of the appendedclaims.

What is claimed is:
 1. A method of operating an electronic device forplayback of a multilayered media file, the method comprising: receivingdevice data from a triggering device via a wireless protocol, the devicedata related to a plurality of triggers of the triggering device, eachof the triggers is associated with a distinct layer of a plurality oflayers of the multilayered media file; and controlling playback of theplurality of layers of media associated with the multilayered media filebased on the device data.
 2. The method of claim 1, further comprising:displaying each of one or more of the triggers as a beam on a display ofthe electronic device.
 3. The method of claim 1, wherein the device datais received in accordance with a wireless personal area network (WPAN)protocol.
 4. The method of claim 3, wherein the WPAN protocol isBluetooth Low Energy (BLE).
 5. The method of claim 1, wherein the devicedata is received as a packet that comprises one or more of a sensorstatus payload, a switch status payload, an encoder status payload, andan error status payload.
 6. The method of claim 5, wherein the sensorstatus payload comprises one or more sensor bits associated with theplurality of triggers and each sensor bit is associated with a triggerof the triggering device.
 7. The method of claim 1, wherein: themultilayered media file comprises a plurality of musical programs, eachof the musical programs comprises a subset of a predetermined musicalcomposition, each of the musical programs is correlated to each other,each of the musical programs comprises sound elements configured togenerate sympathetic musical sounds, and one of the triggers isassociated with one of the musical programs.
 8. The method of claim 5,wherein the switch status payload comprises one or more status bits thatindicate a status of one or more of a mute button of the triggeringdevice, a record button of the triggering device, a volume down buttonof the triggering device, a volume up button of the triggering device, arhythm button of the triggering device, a last song button of thetriggering device, a swap button of the triggering device, and a nextsong button of the triggering device.
 9. The method of claim 5, whereinthe encoder status payload comprises a plurality of encoder bits whereinincrementally larger values are associated with increasing volume andincrementally smaller values are associated with decreasing volume. 10.The method of claim 9, wherein when a sensor bit of the sensor statuspayload indicates a trigger associated with the sensor bit is activated,changes to the plurality of encoder bits are associated with a change ofan attribute of a layer associated with the trigger.
 11. A method of atriggering device used for playback of a multilayered media file, themethod comprising: transmitting device data from a triggering device viaa wireless protocol, the device data related to a plurality of triggersof the triggering device, each of the triggers is associated with adistinct layer of a plurality of layers of the multilayered media file,wherein an electronic device that receives the device data controlsplayback of the plurality of layers of media associated with themultilayered media file based on the device data.
 12. The method ofclaim 11, wherein each of one or more of the triggers is displayed as abeam on a display of the electronic device.
 13. The method of claim 11,wherein the device data is transmitted in accordance with a wirelesspersonal area network (WPAN) protocol.
 14. The method of claim 13,wherein the WPAN protocol is Bluetooth Low Energy (BLE).
 15. The methodof claim 11, wherein the device data is transmitted as a packet thatcomprises one or more of a sensor status payload, a switch statuspayload, an encoder status payload, and an error status payload.
 16. Themethod of claim 15, wherein the sensor status payload comprises one ormore sensor bits associated with the plurality of triggers and eachsensor bit is associated with a trigger of the triggering device. 17.The method of claim 11, wherein: the multilayered media file comprises aplurality of musical programs, each of the musical programs comprises asubset of a predetermined musical composition, each of the musicalprograms is correlated to each other, each of the musical programscomprises sound elements configured to generate sympathetic musicalsounds, and one of the triggers is associated with one of the musicalprograms.
 18. The method of claim 15, wherein the switch status payloadcomprises one or more status bits that indicate a status of one or moreof a mute button of the triggering device, a record button of thetriggering device, a volume down button of the triggering device, avolume up button of the triggering device, a rhythm button of thetriggering device, a last song button of the triggering device, a swapbutton of the triggering device, and a next song button of thetriggering device.
 19. The method of claim 15, wherein the encoderstatus payload comprises a plurality of encoder bits whereinincrementally larger values are associated with increasing volume andincrementally smaller values are associated with decreasing volume. 20.The method of claim 19, wherein when a sensor bit of the sensor statuspayload indicates a trigger associated with the sensor bit is activated,changes to the plurality of encoder bits are associated with a change ofan attribute of a layer associated with the trigger.
 21. An apparatusfor playback of a multilayered media file, the apparatus comprising: areceiver configured to receive device data from a triggering device viaa wireless protocol, the device data related to a plurality of triggersof the triggering device, each of the triggers is associated with adistinct layer of a plurality of layers of the multilayered media file;and one or more processors configured to control playback of theplurality of layers of media associated with the multilayered media filebased on the device data.
 22. The apparatus of claim 21, furthercomprising: the one or more processors further configured to causedisplay of each of one or more of the triggers as a beam on a display ofthe apparatus.
 23. The apparatus of claim 21, wherein the device data isreceived in accordance with a wireless personal area network (WPAN)protocol.
 24. The apparatus of claim 23, wherein the WPAN protocol isBluetooth Low Energy (BLE).
 25. The apparatus of claim 21, wherein thedevice data is received as a packet that comprises one or more of asensor status payload, a switch status payload, an encoder statuspayload, and an error status payload.
 26. The apparatus of claim 25,wherein the sensor status payload comprises one or more sensor bitsassociated with the plurality of triggers and each sensor bit isassociated with a trigger of the triggering device.
 27. The apparatus ofclaim 21, wherein: the multilayered media file comprises a plurality ofmusical programs, each of the musical programs comprises a subset of apredetermined musical composition, each of the musical programs iscorrelated to each other, each of the musical programs comprises soundelements configured to generate sympathetic musical sounds, and one ofthe triggers is associated with one of the musical programs.
 28. Theapparatus of claim 25, wherein the switch status payload comprises oneor more status bits that indicate a status of one or more of a mutebutton of the triggering device, a record button of the triggeringdevice, a volume down button of the triggering device, a volume upbutton of the triggering device, a rhythm button of the triggeringdevice, a last song button of the triggering device, a swap button ofthe triggering device, and a next song button of the triggering device.29. The apparatus of claim 25, wherein the encoder status payloadcomprises a plurality of encoder bits wherein incrementally largervalues are associated with increasing volume and incrementally smallervalues are associated with decreasing volume.
 30. The apparatus of claim29, wherein when a sensor bit of the sensor status payload indicates atrigger associated with the sensor bit is activated, changes to theplurality of encoder bits are associated with a change of an attributeof a layer associated with the trigger.